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ABSTRACT 



The disclosure relates to demotion of data to a backing 
store (disk storage apparatus — DASD) from a random 
access cache in a peripheral data storage system. A 
cache replacement control list, such as a least recently 
used (LRU) list is scanned in a soon-to-be replaced first 
portion (portion closest to LRU entry) to identify first 
data to be demoted. Then the control list is scanned in 
first and second portions to identify further data to be 
demoted with the first data as a single group of data. In 
DASD, such data is all storable in the same cylinder of 
the DASD. 

15 Claims, 12 Drawing Figures 
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intricate. Accordingly, evaluation programs for storage 
METHOD AND APPARATUS FOR GROUPING hierarchies have been used to evaluate how best to 
ASYNCHRONOUS RECORDING OPERATIONS manage a storage hierarchy. U.S. Pat. Nos. 3,964,026 

and 4,068,304 show performance monitoring of storage 
FIELD OF THE INVENTION 5 hierarchies for achieving these goals. Even at that, 

The present invention relates to multilevel data stor- much remains to be done in various types of data stor- 
age hierarchies, more particularly to the control thereof age hierarchies for enhancing optimum performance 
with respect to transferring data from an upper to a while ensuring data integrity. Much of the work with 
data-storage level in such a hierarchy. respect to storage hierarchies has occurred in the cache 

A „ ^ . 10 and main memory combinations as connected to a using 

DISCUSSION OF THE PRIOR ART CPU. Principled teachings of a cached main men; 

Peripheral data storage hierarchies have been used ory relate directly to caching and buffering peripheral 
for years for providing an apparent store as suggested systems as originally suggested by Eden, et al, supra, 
by Eden, et al in U.S. Pat. No. 3,569,938. Eden, el al which relate to caching or buffering data outside of the 
teach that, in a demand paging or request system, each- 15 host processor. Main memory has been used prior to 
ing data into a high-speed storage (burTer) can make Eden, et al for buffering or caching data from a mag- 
peripheral data storage systems appear to have a Urge netic ^ md unit for a CPU, i.e., a main memory 
capacity, yet provide rapid access to data storage areas; was not on ] y uscd ^ a CPU working memory but also 
this rapid access is faster than that provided by the a buffer for peripheral devices, 
backing store. Eden, et al also teach that the backing 20 ^ ^ ^ ^ ^ d ^ ^ 

store can provide retentive data storage, such as mag- ers store SChCid]ed aging ^ d swappmg data , such ^ 
net* : tape recorders and magnetic disk recorders, while ^ ^ used \n connection with paging and swapping 
the front store can be non-volatile, such as magnetic ^„ nw9% . , Q c _ * mf „^ „S7*Zu Z £ 
» , , . ^ l i program data sets. An example ol sucn a paging store is 

core memory. With the advances m memory technol- K , nu , , ■! w ~* , v . u - 

♦v r , • ^ . „ . / ^ am > 25 *c IBM 2305 Fixed Head Storage Module, which is 

ogy, the front store is typically now made from semi- , .... ... — A -™ , * w 

inductive type memory elements, a volatile memory. dc f c " b ^'" P^ t,on GA26-1589-3 

U.S. Pat. No^839.7<H shows another form of a date f ° r J BM 2 ™ St ™? Contro and IBM 2305 Fixed 

storage hierarchy. Head Storage Module , available from International 
An important aspect of data storage hierarchies is Business Machines Corporation, Armonk, N.Y. This 
enabling data integrity. That is, the data received from 30 peripheral data storage system consists of a magnetic 
a user, such as a central processing unit (CPU), or other storage drum which provides rapid access to the stored 
data handling device should be returned to the supply- data. Because of its limited storage capacity, larger 
ing unit either correct or with an indication that errors hosts requiring larger capacities cannot always use the 
may exist. Accordingly, it is typical practice in data IBM 2305 paging store to its maximum efficiency; extra 
storage hierarchies to move data from a higher level to 35 capacity is provided by disk-type direct-access storage 
a lower level for retentive storage, as well as limiting devices (DASD). Such is particularly true when se- 
ttle data in the higher levels such that other data can called swapping data sets are used, i.e., large sequential 
also be stored for rapid access. U.S. Pat No. 4,020,466 sets of data are rapidly transferred between a host and a 
shows copying changes from a high-level store to a peripheral memory. To alleviate storage capacity limi- 
backing store. U.S. Pat. No. 4,077,059 shows forcing 40 tations, while not sacrificing performance criteria, a 
copyback under predetermined conditions. Such copy- hierarchical store can be substituted for the 2305 stor- 
back operations can consume data storage hierarchy age drum. 

performance capability; i.e., so much data may be cop- i n a data storage hierarchy with a random-access 
ied back that access to the data by a using unit may be volatile front store and a DASD backing store, data 
degraded. This problem is partially solved by U.S. Pat. 45 ^^f^ between the front store, also termed a cache. 
No. 3,588,839 which teaches that the only data that ^ DAsD ^ g^ped; accordingly, a simple 
need be copied back from a high-level storage unit to a but da^-transfcr grouping mechanism is de- 
low-level storage unit is that data that* altered, i.e. M fQt ±c ^ required for ^ data trans- 
where there is noncongruence between data stored in a fm host mieTventi on. In particular, it is desired 

backing store and data stored in a front store. 50 . . . r r> A »n u**v*« M „k* 

« e , . ... . . _ to move data from cache to DASD before cache stor- 

Storage hierarchies have taken diverse forms. For mm t ^ . . - _ ■ „ ^.i™ Af%tt% \m~a*<* 

example^ in accordance with the Eden, et al U.S. Pat * needed for stonng other data. Moving 

No.3^9,938,asS^ "^J" ^^^rS^^n^S^ 

users. U.S. Pat No T^^ows that each proces- * ^J?J *t ™ T ^ 

sor can have its own high-speed store or cache. Perfor- 55 S ^ ™ L ^™> Volume 23. No 12 May 1981, 
mance of the data storage hierarchies also is affected by Pf ges 5426and 5427, m an ardcle enntJed "Preventive 
the algorithms and other controls used to place predc- Cast-Out Operations m Cache Hierarchies. This article 
tennined data into the cache or high-speed storage ^ scanning for altered data in an MRU (most 
portion. Accordingly, U.S. Pat. No. 3,898,624 shows rcccnlly used>LRU (least recently used) list for the 
that varying the time of fetching data from a backing 60 purpose of transferring a copy of altered data from a 
store to a front or caching store can be selected by a fr °nt store, or cache, to a backing store such that when 
computer operator in accordance with the programs a replacement algorithm is invoked, that data need not 
being executed in a using CPU. In this manner, it is be then transferred from the cache to the backing store, 
hoped that the data resident in the cache, or upper level This prior art shows scanning an MRU-LRU list from 
of the hierarchy, will be that data needed by the CPU 65 the LRU end for transferring data from cache to DASD 
while data not needed is not resident in cache for allow- to make the replacement algorithm more efficient It 
ing more useful data to be stored in the higher level does not show batching or grouping related data to 
storage portion. All of these operations become quite enable a block transfer of data. 
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/ _ k _ i _ xj FIG. 6 is a simplified machine-operations flow dia- 

SUMMARY OF THE INVENTION gram for a read command execution together with a 

It is an object of the invention to provide an efficient cache hit logic flow for the FIGS. 1 and 2 illustrated 

data grouping control for a data storage hierarchy. data storage system. 

In accordance with the invention, a cache (usually 5 FIGS. 7 and 8 jointly show a machine-operations 

volatile) replacement overlay control list is maintained. flow diagram related to the promotion of sequential 

Such a list is preferably based upon least-recent usage, data from a backing store to a front, or cache, store 

although other criteria may be employed. During pre- including preparatory portions and internal command 

determined times, the cache replacement control list is word portions for the FIGS. 1 and 2 illustrated data 

scanned for finding modified data in the cache to be 10 storage system. 

moved to a backing retentive store, preferably consist- FIG- ^« simplified machine-operations flow chart 
ing of direct-access storage devices. The cache replace- showing machine control processing following a cache 
raent control list has an availability threshold which is a mm - . j- 
predetermined percentage of all of the addressable stor- FIG. 10 is a simplified machine-operations How chart 
age slots, or areas, of the front store, or cache. Any 15 which il,ustrates write grouping of asynchronous writ- 
modified slot on the cache replacement control list mg operations. . , ^ . n . , 

below the availability threshold, when scanned, results «?■ 11 is a simplified machme^raUons flow chart 

in a data transfer being initiated from the cache to the f owin S s^nmg queues of grouped data to be written 

DASD. Before initiating such transfer, all data slots of ^ fr ™J5*<;he to DASD 

the cache below a second and higher threshold, called a 20 FIG. 12 is a simplified machine-operations flow chart 

group or batch threshold, are scanned to identify all show10 * cxccuUon of a modc command, 

other data up to a predetermined limit in the cache that DETAILED DESCRIPTION 

ismodiHed and resides within the s^e ^c«s^ejay Rc now more to ^ dm ^ ng> uUe 

boundaries of the backing store. In DASD the delay ^ numeni]$ * dicale ^ ^ ^ structural features in 

boundaries are switching from one cylinder oftracks to the various dia9naa% An hierarchical peripheral data 

another cylinder of tracks. The prcdetemuned limit is st ^ 10 h attached to a host processor (here- 

also partially determined by the data transfer character. mftf £ host) n for recciving ^ supply, 

istics into and out of Oie cache^ Once all of the related . ^ rf ^ for the host In a typica , application of 

data blocks are identified, the date blocks are grouped 3Q ^ storage system 10 , host 11 consists of a central 

into a single queue. Thereafter the data transfers are processing unit (C PU). In other variations, host 11 can 

initiated. be a virtual machine or a set of virtual machines running 

In a secondary aspect of the invention, a discard list is ona hardware CPU. Host 11 may also be a multiproces- 

maintained. The discard list is first examined for data ^ a uniprocessor with attached processors and the 

blocks to be discarded. All of the blocks to be discarded 35 like while the invention can be applied to a great vari- 

are first discarded before initiating a write date transfer. e ty of data storage systems 10, the preferred and illus- 

In this manner, addressable storage areas of the cache trated embodiment shows a paging peripheral data stor- 

are made available for allocation to data storage, or agc systcm f or handling paging and swapping data sets, 

free, first upon that data which can be discarded, and Generally, such paging and swapping data sets relate to 

then secondly upon data which may have to be re- 40 storage of program data sets for host 11. As such, stor- 

corded in the retentive, or backing, store. age system 10 is usually attached to a single host while 

The foregoing and other objects, features, and ad van- a general-application peripheral storage system can be 

tages of the invention will be apparent from the follow- attached to a plurality of such hosts. The invention can 

ing more particular description of the preferred embodi- he applied to either type of peripheral date storage 

ments of the invention, as illustrated in the accompany- 45 systems. 

ing drawings. Communications between the paging storage system 

DESCRIPTION OF THE DRAWINGS 10 ^ " " T 1 ? a P^*/ of faput/outpul con- 

nections 12-15 which are constructed m accordance 

FIG. 1 is a logic diagram illustrating a peripheral data with the input/output peripheral channels of the IBM 

storage system connected to a host which incorporates 50 370 series of computers available from International 

the present invention. Also shown are channel com- Business Machines Corporation, Annonk, N.Y. Such 

mand and internal command words and a cache re* input/output connections, commonly referred to as 

placement control list used in connection with practic- channels and subchannels, are so well known that their 

ing the invention. description is not necessary. Storage system 10 has a 

FIG. 2 is a logic block diagram of a preferred imple- 55 lower, or backing, storage portion consisting of a plu- 

mentation of the FIG. 1 illustrated system employing a rality of direct access storage devices (DASD) 16 and 

programmed processor for controlling the peripheral separately enumerated DO, Dl, . . . All accessing of 

data storage system. stored data and storage of data by host 11 with respect 

FIG. 3 illustrates various data structures used in con- to peripheral data storage system 10 is by addressing the 

nection with the operation of the FIGS. 1 and 2 illus- 60 DASDs 16. This addressing is achieved by using the 

trated peripheral data storage system. architecture of the input/output connections 12-15 

FIG. 4 shows a practical implementation of the cache using channel command words (CCW) 19 as used in the 

replacement control list when employing a least-recent channels for the IBM-designed input/output connec- 

usage cache replacement or overlay criterion. tions. Typically, each channel command word 19 in- 

FIG. 5 diagrammaticaJly illustrates a mode of opera- 65 eludes an address byte 20. Each address byte 20 in- 

tion of the FIGS. 1 and 2 illustrated peripheral memory eludes a plurality of bits for designating the control unit 

system employing channel command words and inter- (CU) which is to receive the command. A second plu- 

naJ command words. rality of bits uniquely identifies the device (herein also 
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referred to as DASD) 16 to be accessed. In a paging and other functions as is well known for controlling this 
swapping peripheral storage system 10, each of the type of peripheral data storage apparatus. The relation- 
devices 16 is provided with a plurality of logical device ships of cache 40 to devices 16 are substantially identi- 
addresses, i.e., device DO, for example, can be addressed cal to the relationships between host 11 and devices 16. 
by any one of four addresses. Such multiple addressing 5 That is, while host 11 provides control via a series of 
has been practiced in the IBM 2305 paging storage CCWs 19, control 31 provides access between cache 40 
system. The logical addresses for each device are indi- and devices 16 by using a plurality of interna) control 
cated in yet other bits of address byte 20. In the present words (ICWs) which are structured in a similar manner 
description, there are two logical device address bits for to the CCWs, as will become apparent. Certain efficien- 
indicating which of the four logical addresses are being 10 cies in data transfer operations can be provided by alter- 
used by host 11 to address a device 16. In the presently ing the ICWs 24 with respect to the CCWs 19. Instead 
constructed embodiment, one of the logical addresses of going through the channel adaptors 32, control 31 
00 designates a direct access to devices 16. That is, host includes a cache access control CAC 61 which operates 
11 operates with a device 16 as if peripheral data storage system storage 30 and provides access to devices 16 
system 10 were not a hierarchical system. When the 15 through direct access control DAC 56 using the ICWs 
logical address bits are equal to 01, 10 or 11, the hierar- 24. Instead of channel adaptors 32, a linkage port LKP 
chy, later described, is accessed for obtaining data from 25 provides for transfers between CAC 61 and DAC 56. 
devices 16 or supplying data to those devices such that LKP 25 is described later with respect to FIG. 3. 
the apparent performance of those devices is enhanced Each ICW 24 includes a command byte 26 corre- 
on those three logical device addresses. 20 spending to CCW command byte 21. It should be ap- 

A second byte of CCW 19 is command byte 21, predated that the code permutations for identical com- 
which contains a code permutation signifying to periph- mands are the same. Some additional commands may be 
eral data storage system 10 what function is to be per- provided while some of the CCW commands are dis- 
formed. The illustrated command, SPP, is a set paging pensed with. A command modifier byte 27 includes a 
parameter (mode set) command. A third byte 22 is a 25 chain control bit "CHAIN" which replaces the chain- 
command modifier byte having a plurality of control ing indication normally provided by host 11 to control 
fields which electrically indicate to peripheral data 31 via channel adaptors 32. (The chaining indication by 
storage system 10 various modes of operation for exe- host 11 is the supplying of a SUPPRESS OUT tag 
cuting the command indicated in byte 21. One bit SEQ signal.) Bytes 23 of each ICW 24 point to a stored 1 oca- 
indicates to peripheral data storage system 10 that the 30 tion of the address of the devices 16. No logical ad- 
data to be transferred in an upcoming set of transfers dresses are used in the ICWs. In fact, control 31 con- 
will be sequential data. When SEQ portion of byte 22 verts all of the logical addresses directed to the hierar- 
indicates sequential data, then an additional command chy into actual device address bits. Address bytes 28 not 
modifier byte (not shown) is included in the CCW 19 only point to the stored location of the device address 
for indicating the number of blocks or segments of data 35 but also point to the cylinder address (Q, the head or 
which will be transferred from devices 16 to host 11, or track address (H) and the record address (R). The data 
in the reverse direction, as a sequential set of data. Such record or block address corresponds to a sector address 
sequential sets of data in a paging environment are often used in addressing most disk storage apparatus. In a 
referred to as swapping data sets. Additionally, byte 22 preferred embodiment, four records were provided on a 
can indicate read and discard in section RD, which 40 single track (H address); hence, the record address is 1, 
means that once host 11 obtains data from the hierar- 2, 3 or 4, corresponding to an effective orientation of 0% 
chy, that data in the hierarchy cache can be discarded; 90*, 180% and 270* of the disk with respect to a refer- 
the data in the devices 16 is retained. Further controls ence rotational point. Design parameters may dictate 
(not shown) may also be provided. actual rotational orientations that may differ from the 

The data storage hierarchy includes a system storage 45 orthogonal orientations. Received record addresses are 
30 of the semiconductor random access type which has all converted to one of the four rotational record ad- 
a portion 40 designated as a cache for devices 16. Cach- dresses. 

ing principles are sufficiently well known that the pur- Cache 40 transfers data signals with host 11 through 
poses and intent of cache 40 with respect to devices 16 channel adaptors 32 and bus 41. In a similar manner, 
need not be detailed. Control 31 receives the peripheral 50 data is transferred between devices 16 and cache 40 
commands from host 11 for accessing devices 16 using through data circuits 33 and bus 42. When simultaneous 
one of the logical device addresses as well as providing transfers between cache 40 and host 11 or DASDs 16 
access to cache 40 based upon the other three logical are not desired, buses 41 and 42 are combined into a 
device addresses. Data is asynchronously (with respect single bus which is time-shared by the data transfers, 
to host operations) and automatically transferred by 55 Accessing cache 40, which can be a relatively large 
peripheral data storage system 10 between cache 40 and memory (several megabytes), requires CAC 61 to trans- 
devices 16. (Transfers from devices 16 to cache 40 in fer the device address together with the cylinder and 
response to host requests are synchronous transfers.) record addresses CHR over bus 64 to hash circuit 44. 
The data transfers are achieved using the same princi- Hash circuit 44, which function may be microcode 
pies of data transfer as between host 11 and devices 16. 60 implemented, converts the received DASD address 
For example, host 11 accesses devices 16 in a direct . into a hash class indicator. Since the storage capacity of 
mode via channel adaptors 32, individually denomi- cache 40 is much less than devices 16, for ease of access 
nated CAA, CAB, CAC and CAD, then over bus 70 the address ranges of devices 16 are concentrated into 
under control of direct access control DAC 56 through classes called hash classes. A scatter index table SIT 45 
data circuits 33, device adaptor 34 and device control 65 has one register for each of the classes defined by hash 
attachment DCA 35. Received commands 19 are inter- circuit 44. The contents of the registers in SIT 45 are 
preted by control 31 for determining the direction of address pointers to a directory DIR 43 which contains 
data flow between host 11 and devices 16 as well as the address DCHR used to access devices 16. When 
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data is stored in cache 40, the DASD 16 DCHR address 
together with the cache 40 address is stored in a so- 
called entry (register) of DIR 43. Since a plurality of 
device addresses corresponds to one hash class, a sing- 
ly-linked hash class list is provided in the entries of DIR 
43 such that scanning cache 40 using hashing only re- 
quires scanning the entries within a given hash class. 
Based upon the contents of directory 43, cache 40 is 
accessed using known techniques. If no related entries 
to the access request are found in directory 43, then a 
cache miss occurs, requiring CAC 61 either to allocate 
space in cache 40 for receiving data from host 11 or to 
transfer data from a device 16 using ICWs 24 and link- 
age port LKF 25. Control 31 also includes the usual 
control portions of control units that attach to hosts. 
For example, address and command evaluator ACE 50 
communicates with channel adaptors 32 via buses 51, 
52, 53, and 54 for receiving command signals from host 
11 and supplying status signals to host 11. ACE 50 eval- 
uates CCWs 19 and instructs the peripheral memory 
system 10 to perform the commanded function as well 
as indicating the chaining conditions and receiving sta- 
tus signals from the other portions of the peripheral 
system for relaying to host 11. In a direct mode, ACE 
50 supplies command signals over bus 55 to DAC 56 
such that data signals can be transferred over bus 70 
between data circuits 33 and the appropriate channel 
adaptor 32 using known DASD peripheral storage de- 
vice techniques. In executing its functions, DAC 56 
exercises control over data circuits 33 in the usual man- 
ner. 

The operation of the data storage hierarchy is such 
that sequential data sets can be placed in cache 40 using 
a minimal-size cache with minimal allocation controls 
while maintaining sequentially in an efficient manner 
and maintaining a sufficient number of the data blocks 
in cache to satisfy the operating requirements of host 11. 
ACE 50, when receiving a logical device address in 
byte 20, supplies the received command signals over 
one of the three buses 60 (in accordance with the logical 
address) to CAC 61. The three buses are logical buses 
indicating the respective cache 40 accesses. CAC 61 
stores the received command and modifier data in a 
logical device control block LDCB 62. Remember 
there are three logical device addresses for each of the 
devices. Therefore if there are eight devices 16, there 
will be twenty-four LDCBs 62. 

The identification and operational status of each logi- 
cal device is kept in a respective one of logical device 
control blocks LDCB 62. Access to the logical device, 
which is represented by allocation of registers in cache 
40 to the device address, is via address bus 64 to hash 
circuit 44. In certain situations for sequential data, se- 
quential addresses for devices 16 (CHR portion) succes- 
sive registers in SIT 45 can be accessed. Accordingly, 
CAC 61 accesses SIT 45 via bus 65 to avoid the delay in 
hash circuit 44. This operation enhances the response of 
peripheral system 10 to host 11 when sequential data is 
being processed. 

When CAC 61 receives a cache miss indication from 
searching the hash class of DIR 43, for a read request a 
request for a data transfer from devices 16 to cache 40 
is supplied over bus 66 to DAC 56 via LKP 25. The bus 
66 signal alerts DAC 56 to the request and indicates the 
ICWs are addressable via LKP 25. In the preferred 
microcode embodiment, LKP 25 is a microcode linkage 
port, as will become apparent DAC 56 responds to the 
ICWs 24 in the same manner that it responds to the 
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CCWs 19. Upon completion of the rear data transfer 
(DASD to cache 40), as requested through LKP 25, 
DAC 56 supplies status signals over bus 67 to CAC 61. 
At that time, cache 40 has data available to host 11. A 

5 write miss usually results in cache 40 space being allo- 
cated and then receiving data from the host. 

Further communications between CAC 61 and DAC 
56 are via bus 68, all such communications including 
storing message data in LKP 25. Because devices 16 are 

10 accessed through a plurality of logical device addresses, 
a set of queuing registers Q 69 queue device-related 
operations requested by CAC 61. In this manner, DAC 
56 may not be concerned with the queuing requests 
through the logical devices but can operate in a direct- 

15 access DASD mode for host 11 and for CAC 61. DAC 
56 can be used not only in connection with the data 
storage hierarchy, but can be used also in those periph- 
eral storage systems not employing a hierarchy. 
CAC 61 also includes additional controls, for exam- 

20 pie, register ADEB 76 contains one entry of directory 
43 with which CAC 61 is currently operating. The 
address of a device 16 resulted in a cache 40 hit or a 
portion of cache 40 was allocated to data to be supplied 
by host 11; by placing the entry in register ADEB 76, 

25 operation of CAC 61 is enhanced. That is, directory 43 
is a part of system storage 30; by placing the active 
entry in ADEB 76, system storage 30 is free to transfer 
data over buses 41 and 42 independent of control 31. 
Device buffer (DEV BUF) registers 77 contain control 

30 information relating to a device 16 and are used by 
CAC 61 in setting up accesses through DAC 56. Such 
registers are found in a writable control store in the 
microcoded implementation of the invention. Buffer 77 
is merely an allocated portion of control store with no 

35 designated data structure. BST 78 is a buffer sequence 
table described later with respect to FIG. 3. BST 78 
includes pointers to directory 43 for each of the data 
blocks to be transferred in a sequence of data blocks 
over bus 42 as well as a scanning control mechanism for 

40 determining which directory index is to be used for 
accessing cache 40 during the sequential transfer. In this 
manner, a sequential transfer can dispense with address- 
ing setups such that a burst of blocks from a device 16 
can be made without interruption, as will become ap- 

45 parent. CCB 63 is a channel control block containing 
control information about a present data transfer being 
made via a channel adaptor 32. FBL 79 is a free block 
list indicating which of the cache 40 addressable storage 
areas (blocks, slots, etc.) is currently available for allo- 

50 cation to receive and store data signals from either host 
11 or device 16. It is a purpose of the present invention 
to keep FBL 79 at a given maximal number of entries. 

Directory 43 includes a cache replacement LRU list 
46. LRU list 46 signifies least recent usage as criteria for 

35 arranging the list of cache 40 addressable areas for es- 
tablishing a replacement control. The LRU list 46 in the 
practical embodiment is illustrated in FIG. 4. Logically, 
it is shown in FIG. 1 for making the practice of the 
present invention more easily understood. LRU list 46 

60 includes a first and second portion. A first portion 47 
signifies whether or not the data contained in the identi- 
fied addressable area has been modified (such modifica- 
tions and LRU list are in directory 43). The addressable 
areas are listed in accordance with the most recent 

65 usage (MRU) of the respective addressable data storage 
areas by host 11 through channel adaptors 32. The last- 
referenced addressable storage area of cache 40 is the 
most recently used (MRU) addressable storage area. As 
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such, it is listed as MRU-0 in LRU 46. As shown in reduces the number of times a device 16 has to be se- 
F1G. 1, MRU-0 which is identified by a cache address, lected and thereby creates efficiency in data transfers, 
for example, has been modified, i.c, the last reference FIG. 2 is a block diagram of a preferred embodiment 
was a write reference. In a similar manner, the next of the FIG. I illustrated system which employs a pro- 
most recently used addressable data storage area of 5 grammed microprocessor 31P within control 31. Bus 70 
cache 40 is MRU-1; in the illustration that data was also extends from channel adaptors 32 to data circuits 33 and 
modified such that the data in cache 40 is different than operates in an identical manner as shown for FIG. 1. 
the data stored in the corresponding device 16. How- Buses 41 and 42 extend respectively from channel adap- 
ever, MRU-2, the third most recently used addressable tors 32 and data circuits 33 to system storage 30. Buses 
data storage area of cache 40, has data stored in cache 10 41 and 42 ma y combined into one bus with data 
40 identical to the data stored in the corresponding transfers time-sharing the single bus. Processor 31P, in 
device 16. The lesser recent usage proceeds to the least controlling the transfer between data circuits 33 and 
recently used addressable storage area, LRU+0. The system storage 30, provides control signals over bus 71 
next least recently used addressable storage area of 10 circuits 33 and address and sequencing control sig- 
cache 40 is LRU+ 1 and so forth. In a large cache 40, it 15 ^ over bus 72 to system storage 30. A plurality of 
is to be appreciated that a corresponding large number s y stero storage address registers SSAR 58 provide ad- 
of entries occur in LRU 46. for example, in the thou. dresses £ 30 ^example, eight or 

sands sixteen SSARs 58 may be provided. Therefore when 

All' of the addressable storage areas of cache 40, processor 31 P accesses system storage 30 not only does 
which in LRU list 46 lie between LRU+0 and 20 ' t » ve f he of ! to ™£«[ 30 to an SSAR 

LRU+N are below the availability threshold at 49. ?»• but « ?*> } ndlcates which of the SSARs is to be used 
When LRU list 46 is scanned and when an entry identi- m accessm « the "fW Multiplex addressing rejpsters 
fying an addressable data storage area storing modified '° f™™^ « known and therefore not further de- 
dam is found, a transfer of the data stored in cache 40 „ ln . K^J^f P "T? ™ SSAR 
r l. 1c j j. „ i_i * j • . 25 58 for each block of the burst of sequential data blocks 
for each modified addressable area to device 16 is inrti- . . . . . - . ■ , , 

« » JlL , iL is loaded by processor 31P with the addresses of a cache 

ated A second threshold GT 57 is the upper or group- „ r ^ er \^ po ^ oa of sy8tem storage 30). This prim- 
ing, threshold for grouping data stored in diverse ad- . of system borage 30 means that die cache address 
dressable data storage areas of cache 40 for transfer to a fo * ^ ^ Wocks f Q ^ ttuu£md nced not ^ ]oaded 
DASD 16 as a single stream of data. As mentioned n \nXo an SSAR 58 intermediate the successive sequen. 
earlier, the grouping is united to a cylinder of tracks on ^ transferred blocks. Therefore during the sequen- 
a given device 16 LA cyhnder of tracks is all those tracks tial prcce$SOT np merely refers to an SSAR 

at a common radial position, i.e., can be accessed via for intetrng the transfer of data signals between cache 
electronic switching as opposed to radial movements of 40 and a device 16. It should be noted that cache 40 has 
a set of transducers (not shown). Accordingly, when a 35 a ^en address space within system storage 30. In a 
data transfer is initiated by a scan between LRU+0 and shx ^ kr manncrf directory 43 has a different range of 
AT 49, the scan will continue through GT 57 to assem- addresses, SSARs 58 are separate electronic registers 
ble a group of data blocks to be written to a device 16. outside ^ memory array of system storage 30. Proces- 
For example, LRU+ 1 is the least recently used modi- ^ 31P communicates with channel adaptors 32 over a 
tied block of date stored in cache 40. This action can 40 single bus denominated 51-54. 

result in a plurality of blocks being transferred to a Operation of processor 31P is in accordance with 
device 16. For example, LRU+N can identify data to microcode programs stored in a control store 73 which 
be stored in the same cylinder with the LRU+ 1 identi- ^ preferably writable, although a portion can be writ, 
fied data; hence, will be grouped with LRU+ 1 for aD i e wn ii e another portion containing certain programs 
writing. MRU-M, just above AT 49, can be in a differ- 45 can be read-only. Bus 74 couples the processor 31P to 
ent cylinder; hence, will be outside the group. Other control store 73. Within control store 73 are programs 
blocks of data in cache 40 such as MRU-(K+ 1), just ACE SOP which implement the function of address and 
below GT 57, is modified and can be in the same cylin- command evaluator 50, DAC 56P which are programs 
der as LRU+1. All of the data above GT 57 is not to implement the function of direct access control 56 f 
subject to being written to a device 16 because the 50 CAC program 61P which implements the functions of 
recentness of the last reference indicates there is a cache access control 61 and OP 75 which are other 
strong likelihood that the data may again be quickly programs necessary for operation of the storage system 
referenced by the host 11. Such a reference can be a 10 but which are not necessary to an understanding of 
write reference; therefore, moving data from cache 40 the present invention. The registers storing data struc- 
above GT 57 results in unnecessary data transfers; 55 tures used by processor 31P to control the system 10 via 
hence, degrades performance. the programs 50P, 56P and 61P include CCB 63, LDCB 

In accordance with all of the above, the selection of 62, queue registers 69, ADEB 76, SIT 45, buffer 77, 
AT 49 and GT 57 is based upon the particular operating LKP 25 and BST 78. Also used are later-described 
characteristics by peripheral data storage system 10 as it registers for containing FBL 79, write queue counter 
is currently operating with host 11. This means the 60 WQK 84, j counter 37 and discard list DL 38. For an 
thresholds AT 49 and GT 57 may be subject to change extremely large cache 40, SIT 45 can be stored in sys- 
over extended periods of time. The main essence is that tern storage 30. To enhance performance, a set of regis- 
a first scan up through the availability threshold AT 49 ters for containing a page of SIT 45 can be reserved in 
results in initiating a data transfer. The scan continues to control store 73. 

GT 57 for adding blocks to the data transfer initiated by 65 Operation of the FIG. 2 illustrated preferred erobodi- 
a first found block to be transferred. This continued ment is best understood by reference to FIGS. 3 
scan results in grouping a set of additional data blocks through 12 which illustrate the data structures in detail 
for a group data transfer to a device 16. This grouping as well as machine-operation flow diagrams for the 
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microcode portions necessary for an understanding of being addressed. DIR. INDEX 114 contains a directory 

the operation of the present invention. FIG. 3 illustrates 43 index value for indicating which directory entry 

the data structures used by a processor 31P to operate register contains the entry corresponding to the logical 

peripheral system 10 in accordance with the invention. device identified in the particular LDCB 62 registers. 

LDCB 62 is a scries of registers containing data signals 5 SSAR 115 identifies which SSAR 58 will be used in 

in control store 73 consisting of four sections. A first accessing cache 40 in a data transfer between a device 

section 80 is a so-called foundation data structure which 16 and cache 40. SAVE 117 indicates an area of the 

defines and supports the functions of peripheral system LDCB 62 registers which processor 31P uses to save 

10 in a general operational sense. PPARMS 81 is that control data signals during various operations, includ- 

portion of LDCB 62 relating to the parameters defining 10 ing interruption operations. 

a paging and swapping function established through the ADEB 76 is structured in the same way that each 

later-described set paging parameters command (FIG. entry of directory 43 is structured. Accordingly, de- 

12). CP ARMS 82 contains command parameters such scription of ADEB 76 amounts to a description of direc- 

as set sector, seek, search ID command issued by host tory 43. In each entry of directory 43 as well as ADEB 

11. These commands are those used in connection with 15 76, INDEX 107 is the logical address of the directory 

known disk storage apparatus peripheral storage sys- entry. This field contains self-identifying data for each 

terns. RPARMS 83 contain the parameters for support- entry. Section 108 contains the address of a device 16 

ing read activity; i.e., transferring data signals from corresponding to the data stored in cache or allocated 

device 16 to cache 40. for storage. CCP is the physical cylinder address, i.e. t 

The foundation portion 80 includes a bit ODE 90 20 the actual physical address of the cylinder for a device 
which signifies whether or not a device end (DE) is 16, H is the head address, R is the record address, D is 
owed by peripheral data storage system 10 to host 11. the device address and SECTOR is the actual sector 
CNL MASK 91 contains a bit pattern indicating which value, i.e., rotational position of the disk from which a 
channel adaptor 32 received the current command, i.e., data access will begin. The R value for tracks having 
which channel the logical device has an affinity to. 25 four records can vary from one to four while the sector 
LDADDR 92 contains a code permutation indicating a value is the actual sector address. In addressing the 
logical address received with the command. CMD 93 DASD, the R value is translated into a rotational posi- 
contains the code permutation from byte 21 of FIG. t tion indicator at the byte level as in usual DASD ad- 
SEQ 94 contains the contents of SEQ section of byte 22 dressing techniques. The R value m some host operating 
of FIG. 1. CCR 95 indicates whether a channel com- 30 systems can range from 1-120 or other numbers; in such 
mand retry has been sent to host 11 by data storage cases the larger R values are reduced to a value modulo 
system 10. In this regard, when a cache miss is indicated the number of records N in a track. Then the R value, 
in section 96, a channel command retry is sent to host modulo N, is converted to a rotational address of the 
11. Therefore LDCB 62 signifies at 96 when a miss has disk. Such sector value is suitable for initiating access to 
occurred for cache 40 and whether or not system 10 has 35 a record with a minimal latency delay. CCL is the logi- 
supphed the appropriate CCR signal. Channel com- cal cylinder address such as provided for logical de- 
mand retries merely signify to host 11 that a delay in vices which are defined on physical devices. Link 109 
executing the received peripheral command is required. contains the data signal code permutation of the singly- 
Data storage system 10 upon reaching a state in which linked list for linking all entries of a single hash class 
the command can be executed will send a device end 40 together. The last entry of a given hash class will have 
(DE) signal to the host. The host then sends the previ- a particular code pattern (zeroes) indicating end of 
ous peripheral command such that the command can chain or end of class. M bit 124 indicates whether or not 
then be executed by data storage system 10. the data in cache 40 has been modified since it was 

PPARMS 81 includes a sequential bit 100 corre- received from a device 16; this section corresponds to 

sponding to the sequential bit SEQ in byte 22 as well as 45 M column 47 of FIG. 1. MRUP 125 is a pointer to a next 

the RD indicator 101 from RD section of byte 22. B more recently used addressable storage area of cache 

COUNT 102 contains the number of blocks to be trans- 40, while LRUP 126 is a pointer to a next less recently 

ferred as a sequential set. As each block of the sequen- used addressable storage area of cache 40. These point- 

tial data set is transferred to host 11, B COUNT 102 is ers are the index values of section 107 for the respective 
decremented by one. Therefore, it indicates the number 50 entries. MRUP and LRUP constitute a doubly-linked 

of blocks yet to be transmitted to host 11 through cache list described later with respect to FIG. 4. Other code 

40. BASE CYL 103 contains the cylinder address C permutations can be added to each directory 43 entry 

from which the sequential data will be transmitted from which are not pertinent to an understanding of the pres- 

devices 16, i.e., in a multicylinder request, BASE CYL ent invention. 

103 contains the value C of a virtual machine (VM) 55 LKP 25 is an area in control store 73 accessible by 

minidisk. programs ACE SOP, DAC 56P and CAC 61P which 

CP ARMS 82 contains the DASD seek address in make up a linkage port or message area for controlling 

SEEK ADDR 104, the last or current search ID argu- the interaction of the execution of these microcode 

ment in SID 105 and the last or current set sector value units. In one embodiment, ACE SOP and DAC 56P 
in SECTOR 106. 60 were treated as one code segment such that LKP 25 was 

RPARMS 83 includes REQD 110 indicating that a accessed by those two microcode sections as a single 

data transfer from a device 16 to cache 40 is required. unit. In any event, the structure of the port includes a 

RIP 111 indicates that a read is in progress from a de- code point CP 85 which identifies the portion of the 

vice 16 to cache 40. RA 112 indicates that a read has microcode which lodged the control data in the port, 
been completed from a device 16 and that certain post- 65 That is, when CAC 61P lodges an entry in LKP 25, 

processing functions (not described) are being per- DAC 56P will fetch the control data and execute the 

formed. DADDR 113 contains the device address from function. Then when DAC 56P enters new data in LKP 

byte 20 (FIG. 1) for indicating the accessed device 16 25 responding to the request by CAC 61P, CP 85 indi- 
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catcs to CAC 61P which point in its code execution the ated with DO device 16. Device Dl has two entries in 

DAC 56P reply relates to for continued processing. this read queue, LDCB 1 and LDCB 3 with the pointer 

PRIORITY section 86 contains code permutations indi- number 3 in portion 129 indicating that LDCB 3 is to be 

eating whether the request lodged in LKP 25 is high next serviced. Accessing the read queue 128 enables 

priority, low priority or a continued processing indie a- 5 processor 31P to access the correct LDCB 62 for trans- 

tion. V bit 87 indicates whether or not LKP 25 entry is ferring data from a device 16 to cache 40 in an appropri- 

valid, i.e., is it a recent entry requiring action. DADDR ate sequence relative to the sequence that the data was 

section t& contains the device address from byte 20 for requested by host 11. Other forms of priority determina* 

identifying which device 16 is associated with the cur- tion may be used while practicing the present invention, 

rent LKP 25 control data signals. PARMS 89 contains 10 In addition to the registers shown in FIG. 3, other regis- 

various parameters associated with the message, i.e., ters may be employed in constructing a data storage 

what function is to be performed, status and the like. system 10; these registers are not necessary to an under- 

BST 78 has a set of registers for each of the devices standing of how to practice the present invention in the 

16. A first register includes section DELEP 120 which illustrated environment. 

contains an index value of 1 to 8 pointing to the direc- 15 LRU 46 rather than being a push-down singly-linked 
tory indices 122-123. These indices identify the direc- stack shown in FIG. 1 is preferably a doubly-linked let 
tory entries to be deleted. EK 121 contains a count of as shown in FIG. 4. The list is organized in accordance 
the number of valid entries in the table. It is also used as with the directory 43 index which corresponds to a 
an address; for example, the first directory pointer index cache address CADDR as set forth in column 116. 
is always stored in 122 while the 8th one is always 20 CADDR having a value of one corresponds to the 
stored at 123. For a value of 3 in EK 121, a third direc- lowest memory address of cache 40, while CADDR 
tory index is accessed. Directory index, remember, is a having a value of two indicates the memory address of 
logical address of a directory 43 entry, hence is a rapid cache 40 for the second addressable data storage area of 
access into directory 43. cache 40, and so forth. MRUP 125 is a column of point- 
Operations between system storage 30 and devices 16 25 ers pointing toward entries in LRU list 46 that are die 
are asynchronous and substantially independent of op- more recently used addressable data storage areas of 
erations between host 11 and devices 16 as well as the cache 40. In the FIG. 4 illustration, CADDR M+2 is 
operations between host 11 and system storage 30. To the MRU addressable data storage area of cache as 
achieve this operation, a set of read queues 128 and indicated by the zero in MRUP. In a similar manner, the 
write queues 127 are established in queue registers 69. 30 least recently used pointers LRUP 126 point toward the 
Queue registers 69 include write queue 127 which has a next addressable data storage area identification which 
separate queue for each of the devices labeled D0-D4. is next less recently used. The one that is least recently 
. . . Each write queue register contains the index direc- used is K-f 2 as identified by the zero in LRUP column 
tory 43 stored in the respective INDEX 107 for entries 126. It should be noted that work registers (not shown) 
identifying write operations. The write queues also 35 within processor 31P contain the address of the MRU 
store the addresses necessary for accessing the devices and LRU addressable storage areas such that the LRU 
16 which include a SEEK argument, SEARCH argu- list 46 can be scanned either from the LRU end or the 
ment, SECTOR, device mask and the address portion MRU end (as shown in FIG. 1). The pointers are estab- 
for accessing cache 40, such as the cache block address lished in the usual doubly-linked list pattern. For exam- 
and the SSAR 58. A link field can be included to con- 40 pie, the MRUP of CADDR K-f- 2, the LRU element, is 
tain a pointer to a next entry in the write queue 127 for equal to 1. Going to the CADDR having a value of 1 
the respective devices or for pointing to the next device finds the LRUP with a value of K-f 2 and MRUP hav- 
write operation, i.e., which record in cache 40 is to be ing a value of M which is the next more recently used 
next written to a device 16. Accordingly, write queues element Going to the element having CADDR M M M 
127 can contain one or a plurality of references to cache 45 finds an LRUP value of 1 with an MRUP value of two 
40 addressable storage areas for accessing data blocks to hyphens. Two hyphens indicate that there are addi- 
be written to each device 16. Each write queue includes tional entries in the list not shown for purposes of sim- 
a flag counter 127F which signifies, when non zero, that plicity. In a similar manner, CADDR value 2 has an 
there are a number of entries in write queue 127 equal to LRUP pointer of two hyphens to indicate omitted 
the count in 127F and, when reset to zero, that the 50 entries- For illustrating that the AT and GT thresholds 
associated write queue 127 is empty. Write queue can be anywhere within the doubly-linked list, the 
counter WQK 127K is an 8-bit shift register having one threshold symbols GT 57 and AT 49 are shown as exist- 
bit set to identify which write queue 127 is to be next ing anyplace within the LRU 46 doubly-linked list In a 
scanned for entries. Each scan results in shifting WQK scan for such thresholds, the number of elements 
127K one bit pointing to indicate a next write queue 55 scanned will be counted and compared with a numeri- 
127. cal value for determining whether the threshold has 

Queue 69 also includes read queues 128, each of been reached or not, all as described in FIG. 10. 

which includes portions 128 and 129 which constitute a FIG. 5 illustrates a sequence of CCWs and ICWs in a 

round-robin queue. Portion 128 contains the LDCB 62 read or write data transfer. A read transfer transfers 

addresses for identifying which logical devices require 60 signals from a device 16 to host 11, while the write 

data transfer from a device 16 to cache 40. Portion 129 transfer is a data transfer in the reverse direction. A 

contacts a pointer to one of three possible entries in chain of CCWs 130 begins with set paging parameters 

each queue for indicating which logical device is to be (SPP) CCW 132. FIG. 12 illustrates the execution of 

next serviced. A pointer 129 equalling zero indicates an such a command by storage system 10. Fundamentally, 

empty queue. For example, DO portion 129 contains 65 SPP 132 sets whether or not data read to host 11 from 

numeral 2 indicating that LDCB 2 is to be next serviced; cache 40 can be discarded, as well as other parameters 

following LDCB 2 then LDCB 3 will be serviced, then identified in byte 22 of CCW 19 (FIG. 1). Once SPP has 

1. DO has a full read queue for all logical devices associ- indicated parameters of operation to system 10, a SEEK 
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CCW 133 results in a seek command being transferred leaved. The ICW chains do not necessarily follow the 
to the peripheral storage system; in one embodiment the sequence of chains of CCWs. Depending upon the cir- 
seek parameters were embedded in the SPP command. cumstances, an ICW chain may be constructed and used 
Using normal DASD architecture. SEEK is followed by a later-occurring CCW chain. Such possibility nidi- 
by SET SECTOR CCW 134 which in turn is followed 5 cates the asynchronous aspect of the ICW chains with 
by a search ID equal (SIDE) 135. Now the storage respect to the CCW chains. Usually, the first CCW 
system is ready to read data from an addressed device chain will result in a first-occurring ICW chain. At any 
16 by READ CCW 136. Upon receipt of the READ instant, a separate ICW chain can be active for each 
command, peripheral data storage system 10 provides device. The SEEK, SET SECTOR, and SIDE CCWs 
the action indicated in column 131. First of all, the 10 133-135 are not described since they are well known. 
SEEK, SET SECTOR and SIDE commands are FIG. 6 illustrates the machine operations for transfer- 
stacked as at 140. At 137, a directory 43 search, as ex- ring sequential read data. At step 160 the received com- 
plained with respect to FIG. 1, is conducted. For a mand is processed by ACE SOP. Then through LKP 25, 
cache hit, i.c, the requested data is in cache 40, the data CAC 61P is activated by processor 31P. The command 
is immediately transferred as indicated by arrow 138 15 is again decoded at step 161 by CAC 61P. Since it is a 
from cache 40 to host 11 via the channel adaptor 32 READ command, directory 43 is searched at step 162 
which received the command. On the other hand, if as described with respect to FIG. 1. At step 163, proces- 
directory 43 indicated the data was not in the cache, sor 31P determines whether or not the directory search 
then a cache miss has occurred, as indicated by arrow resulted in a cache hit or a cache miss. For a cache miss, 
141. A channel command retry (CCR) is supplied by 20 the received command is enqueued at step 164 by plac- 
system 10 as indicated by arrow 142. The CCR tells ing the command and its control information in queue 
host 11 that, when a DEVICE END signal is received registers 69. A CCR is sent to host 11. Queue registers 
from system 10, the READ CCW 136 must be reex- 69 can use any format, the queue is a first-in first-out 
ecuted by the channel by sending the same READ queue for each of the addressable devices 16, i.e., for 
command to system 10. While this is occurring, system 25 eight devices 16 there are eight queues. The importance 

10 constructs a chain of ICWs 143-148 beginning with of having a FIFO queue is to ensure that the sequence 
a SEEK ICW 143 which is derived from the stacked of responses to the host for a given device corresponds 
SEEK commands received from host 11. For a multi- to the sequence of commands sent by the host From 
track operation, the ICWs are derived from search ID queue 69, CAC 61P will initiate a read from the ad- 
parameters. The SEEK ICW 143 is followed by a SET 30 dressed device 16 by building an ICW chain 131. 
SECTOR ICW 144 which has the sector calculated A cache hit by directory search at 163 results in cache 
from the record number. At 145, the local input results 40 automatically transferring data to host 11 via the 
in a SET CACHE ICW 145. This ICW causes DAC appropriate channel adaptor 32 at step 170. Such auto- 
56P to insert into the appropriate SSAR 58 the address matic cache-to-host transfers are well known and not 
of system storage 30 at which the data to be read will be 35 described for that reason. During the automatic data 
stored. If a plurality of blocks of data are to be trans- transfer an error can occur; accordingly, upon an error 
ferred, then a plurality of SET CACHE ICWs occur as detection, processor 31P goes to an error reporting and 
indicated by numeral 146. Then a SEARCH ID analyzing routine (not shown). Generally the data trans- 
EQUAL ICW 147 corresponding to the SIDE CCW fers will be error free. At step 171 following the success- 
135 occurs. The SEARCH ID EQUAL ICW 147 cor- 40 ful completion of a data transfer, processor 31P accesses 
responds to the first SET CACHE ICW 145. This LDCB 62 to examine RD section 101. If discard-after- 
means a plurality of blocks of data are read in sequence read is indicated, processor 31P at step 173 sets the 
using but one SIDE ICW 147. Then a number of just-read block of data stored in cache for discard in DL 
READ ICWs 148 equal to the number of data blocks to 38 of control store 73. Discard is performed by proces- 
be transferred are given to DAC 56P for reading a 45 sor 31P (when no commands are being executed) by 
predetermined number of blocks of data indicated by accessing DIR 43 in system storage 30 to erase the 
the number of SET CACHE ICWs. Upon completion directory 43 entry. Discarding the data prior to require- 
of the read, which transfers data from the addressed ment of a replacement algorithm being invoked reduces 
device 16 to cache 40 at the addresses set in SSARs 58, the control required for efficiently managing cache 40, 
system 10 supplies a device end (DE), as indicated by 50 i.e., free addressable data storage areas are made avail- 
arrow 150, to host 11. Host 11 immediately responds by able before they are needed. If RD=0 at step 171, (not 
reissuing a peripheral command at 151 corresponding to rcad-and-discard), processor 31P at step 175 determines 
the CCW 136. Of course, system 10 searches directory from directory 43 in a field (not shown) whether or not 
43 at 152 resulting in a cache hit because of the just- the date is pinned to cache 40. Pinning data to cache 40 
executed ICW chain. Data is then transferred from 55 means that it cannot be erased from cache 40 until a 
cache 40 to host 11 as indicated by arrow 153. In the pinning flag (not shown) of directory 43 has been erased 
event that the data was not transferred for the requested by a host 11 issued command. If the data is not pinned 
data block at CCW 136, another cache miss will occur to cache, then at step 176 the block that was just read is 
and an error status will be reported to host 11. This made the most recently used (MRU) block in the LRU 
error status will reflect the fact that system 10 was 60 list 46 of directory 43. At step 177, nonpertinent logic 
unable to transfer data from the addressed device 16 at steps are performed by processor 31P. Then at step 180, 
the requested cylinder, head and record address. Host LDCB 62 is again accessed for examination of SEQ bit 

11 then can use the direct access route for attempting 100. If sequential data has been indicated for the ad- 
recovery using standard disk storage apparatus recov- dressed device 16, then processor 31P at step 182 exam- 
cry techniques beyond the scope of the present descrip- 65 ines the appropriate LDCB B COUNT 102 to see if the 
tion. Ellipsis 154 indicates that the above-described block count is equal to zero, i.e., is the just-transferred 
operation is highly repetitive as well as indicating that block the last block in the sequence of data. If it is not 
various CCW chains for various devices 16 can be inter- the last block to be transferred, then at step 183 the 
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block count (BK) is decremented by one. From steps 
180. 182 or 183, logic path 181 lead processor 31P back 
to ACE SOP for performing Final status reporting to 
host 11 in a usual manner. 

FIGS. 7 and 8 illustrate scanning the read queues in 5 
queue registers 69 and generating an ICW chain of 
internal data storage system 10 commands. After the 
requested read has been enqueued, processor 31 P causes 
system 10 to perform diverse functions, such as re- 
sponding to host 11 issued commands received over 10 
various ones of the channel adaptors 32, additional com- 
mands received from the channel adaptor 32 which had 
transferred the read command (which was CCR'd). 
When there is a lull in receipt of peripheral commands 
from the host 11, SEEK and SET SECTOR device 15 
commands are sent by processor 31P to devices 16. 
When there is a lull in control activity (which may 
occur while cache 40 is transferring data to host 11, 
receiving data from host 11, transferring or receiving 
data from an addressed device 16) processor 31P 20 
through its dispatcher microcode, which is a portion of 
OP 75 (FIG. 2), scans work tables (not shown), includ- 
ing queue registers 69. If the queues in queue registers 
69 are empty, i.e., no reading nor writing is to occur, 
processor 31P follows logic path 192 returning to dis- 25 
patch er 190. If a read has been enqueued as detected at 
step 191 by scanning the read queue flags 129, the queue 
entry is transferred from a queue register 69 portion 128 
at step 193 to an internal register (not shown) of proces- 
sor 31P. If an error occurs in this queue transfer, an 30 
error reporting and recovery technique (not described) 
is instituted at step 194. Upon successful reading a queue 
entry from a queue register 69, LDCB 62 is accessed at 
step 195 to set ODE section 90 to unity to indicate that 
a DEVICE END is owed upon completion of a sue- 35 
cess ful read (such as indicated in FIG. 5 by arrow 150). 
At step 196 some nonpertinent functions are performed. 
Then at step 200, in the device buffer area 77 corre- 
sponding to the addressed device, a bit (not shown but 
corresponding to bit 27 of FIG. 1) is set to indicate that 40 
logical chaining will occur, i.e., more than one ICW 
will be used in the upcoming access to the addressed 
device 16. At step 201, LDCB 62 is again accessed to 
examine the value of SEQ bit 100. For sequential data 
being indicated, processor 31P proceeds to step 202 to 45 
set up the block count for the upcoming ICW chain 
equal to the received paging parameter (PA) in the 
illustrated embodiment. 

A maximum number of blocks which can be trans- 
ferred through a given ICW chain is equal to the num- 50 
ber of SSARs 58. For example, for eight SSARs the 
number of blocks transferred will be a maximum of 
eight. Further, delay boundaries are a consideration, for 
example, if the eight blocks to be transferred require 
accessing two cylinders; then only those blocks in a 55 
first-accessed cylinder of DASD tracks are transferred. 
For example, if the eight blocks have four blocks in a 
first cylinder and four blocks in a second cylinder, then 
the number of blocks would be set to four. This action 
minimizes the time required to transfer a series of blocks 60 
and enables all transfers to proceed to completion at 
electronic speeds. In the event of a miss on the first 
block of a given cylinder, then up to eight blocks could 
be automatically transferred. Also the maximum num- 
ber of blocks is never greater than the remaining value 65 
in B COUNT 102. The ICW chains are constructed 
such that cylinder boundaries are never crossed by any 
given ICW chain, These calculations follow usual com- 



puter-programming techniques and are not described 
further for that reason. If sequential data is not indicated 
at step 201, then the number of blocks to be transferred 
is set to one at step 203. These numbers are supplied to 
the device buffer 77 along with the chaining flag, device 
16 address and other device control data. At step 204, 
the SSAR 58 identification is set to zero and EK of BST 
is also set to zero. This means that processor 3 IP will 
access the SSAR having identification zero. 

At step 205, the logical address LDADDR received 
via a CCW 19 of FIG. 1 is converted to a physical 
device 16 address. In the illustrated embodiment, this 
action is achieved by merely masking the logical ad- 
dress to delete logtcal-address-indicating bits. Certain 
nonpertinent functions are performed at 206. Point 207 
is reentry point B from a continuation of the machine- 
operation flow diagram described with respect to FIG. 
8, Lc all of the logic steps from 190 through 206 are 
preparatory steps with the following-described steps 
being repeatable as a loop for setting up a succession of 
data block transfers. 

The first step 210 in the loop allocates a slot or ad- 
dressable data storage space in cache 40. Usual alloca- 
tion procedures are followed, i.e., an addressable unit 
(slot) in a so-called free list is identified as the address- 
able unit or slot to receive the first block of signals from 
the addressed device 16. That slot is then removed from 
free list FBL 79 and identified within an internal regis- 
ter (not shown) within processor 31P for identifying 
which directory 43 entry is to be used for identifying 
the slot in cache 40. Note that there is one entry register 
in directory 43 for each addressable slot in cache 40. 
Accordingly, the actual address in cache 40 of the data 
can be derived directly from which register of directory 
43 contains the entry. 

Upon the attempted allocation of the number of slots 
equal to the number of blocks set in steps 202 or 203, 
processor 31P at step 211 determines whether or not 
any error occurred in the allocation process. If an error 
has occurred, the total number of blocks may not be 
successfully transferred from the addressed device 16 to 
cache 40. Accordingly, for an error condition, at step 
212 processor 31P examines LDCB 62 SEQ bit 100 to 
determine if the data transfer is a sequential data trans- 
fer. If it is not a sequential data transfer, processor 31P 
follows logic path 213, returning to ACE 50P to wait 
for a replacement algorithm control to make space 
available for one block. For a sequential data transfer, 
processor 31P at step 214 determines whether or not the 
error occurred on the first block to be transferred. If the 
error is in the first block, processor 31P returns via logic 
path 216 to ACE SOP. If the allocation error is not in the 
first block, then data transfers of the preceding blocks 
occur. Processor 3 IP follows path 217 to step 220 for 
truncating the number of blocks to be transferred in the 
unallocated area from the ICW list, Le., all desired 
blocks beginning with the block associable with the 
allocation error are removed from the ICW chain. 

Returning to step 211, if there were no allocation 
errors, then at step 218 some nonpertinent functions are 
performed. These functions include analyzing micro- 
code logic errors not related to allocation. If a slot was 
not allocated due to such microcode errors, then the 
truncate step 220 is performed for reducing the number 
of blocks transferred from the addressed device 16 to 
cache 40. Without an error or after truncation, proces- 
sor 3 IP performs some nonpertinent logic steps at step 
221. At step 222, LDCB 62 SEQ 100 is examined. If 
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SEQ bit equals zero, i.e., nonsequential data, then at loop 270 is executed for setting up the remaining lCWs 
step 223 the index of the directory 43 entry correspond- 24 in a chain. At step 271,- the command is set for 
ing to the slot in cache 40 to receive the data is entered READ COUNT, KEY, DATA and multrtrack com- 
into LDCB 62 section 114 of RPARMS 83. For sequen- mands. At step 272 processor 31 P determines whether 
tial data or after the index is entered into LDCB 62, at 5 or not the last block in a sequential group of blocks is to 
step 224 the cache address to be inserted later into an be processed. If not, the chaining flag in byte 27 of the 
SSAR 58 is generated from the directory index just ICW being built is set to unity. Otherwise, at step 274 
inserted into LDCB 62. This generation is merely add- the end of chaining condition is indicated by resetting 
ing an ofTset to each of the directory indices. Then at the chaining flag. At step 275 the just constructed ICW 
step 225, LDCB 62 SEQ bit 100 indicating sequential 10 24 is transferred to device buffer 77. At step 276 the 
mode causes processor 31P to examine B COUNT 102 cache address CADDR is stored in device buffer 77 
to see if the count is greater than one, then at step 232 such that it can be transferred immediately to an SSAR 
processor 31P examines to see if the first data block in 58 for the burst transfer. At step 277 processor 31P 
the sequence of blocks being transferred is now being determines if the data block is the last block; if not, the 
handled. If not, at step 233 a new cache address for the 1 5 loop is indexed at step 278, adjusting a count in an inter- 
second block is provided. Then at step 234, in the de- nal register (not shown) using usual control techniques, 
vice buffer area 77, the SSAR 58 corresponding to the Otherwise, step 257 is performed. When the loop is 
second or other blocks is set to the cache address, flags indexed at step 278, the steps 271 through 277 are per- 
are set, pointer to the directory 43 is set and the SSAR formed. 

58 to receive the cache address is identified. Other func- 20 DAC 56P upon receiving the ICW chain executes the 

lions to be performed may also be defined within device chain in the same manner that it executes received 

buffer 77. chained commands through channel adaptors 32. Since 

Returning to steps 225, 231 and 232, the logic path this latter operation is well known, the execution of the 

226 to nonpertinent steps 227 is followed by processor ICW chains is not further described. It should be noted 

31P accessing LDCB 62 to store the generated cache 40 25 that in transferring signals from an addressed device 16 

address in section 116 of RPARMS 83. Then following to cache 40, DAC 56P not only provides the addressing 

nonpertinent steps 229, processor 31P proceeds through to the device 16 but also transfers the cache address 

logic page connector 235 to the logic steps shown in contents of device buffer 77 into SSAR 58 such that 

pro. 8. several blocks of data can be transferred in a single data 

The connection between FIOS. 7 and 8 is through 30 stream. Upon completion of that data transfer, DAC 
connector A denominated by numerals 235 and 240, 56P loads the resultant status, including error indica- 
respectively, in FIGS. 7 and 8. At step 241 processor uons, into LKP 25. The processor 31P operation then 
31P updates the pointer to SSAR 58 by incrementing switches from DAC 56P to CAC 61P. 
EK 121 of FIG. 3. At step 242, processor 31P deter- FIG. 9 shows machine operations performed via 
mines whether or not all of the data blocks to be trans- 35 processor 31P subsequent to a cache miss. These ma- 
ferred to cache 40 have received space allocations in chine operations occur in step 164 of FIG. 6 for exam- 
cache 40. If not, through connector B 243, processor pie. At step 280, processor 31P accesses LDCB 62 for 
31P returns to FIG. 7 flow chart at B 207 to allocate a the addressed logical device for setting CCR 95 and 
cache 40 slot for another data block. This loop is re- MISS 96 fields of the found section 80 to unity. This 
peated until EK 121 contains a count equal to the num- 40 action signifies that a channel command retry was sent 
ber of blocks to be transferred (not more than eight). to host 11 because of a cache miss. These signals will be 

After completing the above-described loop, some used later as explained with respect to FIG. 11. Then at 

nonpertinent logic steps are performed at step 244. At step 281 processor 31P examines FBL 79 to determine if 

step 245, the read command is set into the ICW repre- any of the addressable data storage areas or blocks of 

senting a read data command for a device 16. At step 45 cache 40 are free for allocation. The early cast-out of 

250, LDCB 62 is accessed to determine whether or not data from cache 40 to devices 16 increases the probabil- 

the sequential flag SEQ 100 in PPARMS 81 is set or ity that some blocks will always be free. The free block 

reset. When set, processor 31P at step 251 determines list FBL preferably consists of the LRU 46, entries 

whether or not the received block count is greater than having M bits 47 equal to zero. By keeping the freed 

one. If it is greater than one, then a chaining indication 50 block identification in LRU 46, addressability of the 

is set in command modifier byte 27 of ICW 24 (FIG. 1); identified data is maintained. Steps 300-307 show this 

otherwise from steps 250 or 251 the end of chain indica- operation. Upon finding a freed block, processor 31P 

tion HOC is indicated in byte 27 by resetting that chain follows logic path 282 to allocate step 284 in which a 

indicator. At step 254, the device buffer 77 in control free block identification is removed from FBL 79 and 

store 73 receives the ICW, Le., the code permutation 55 the corresponding entries of directory 43 are changed 

flags and other storage operation (STOROP) indica- from the current identification to identify the device 16 

tions. At step 255, processor 31P again examines SEQ addressable storage area then being allocated to cache 

bit 100 of LDCB 62 for nonsequential, Le,, SEQ =0. If 40. If an error occurs during such allocation procedure, 

a non-sequential data transfer is to occur, processor 31P a well-known procedure, processor 31P leaves step 284 

follows logic path 256 to execute logic step 2S7 for 60 along logic path 285 to error recovery procedures be- 

transmitting the just-constructed ICW to DAC 56P via yond the scope of the present description. When a sepa- 

Ljtp 25. rate FBL 79 is kept, allocate step 284 can be entered 

For a sequential data transfer, processor 31P leaves subsequent to a casting out operation, as described with 

step 255 to execute step 260 for adjusting EK 121 to the respect to FIG. 11, via off-page connector C 283. 

next entry (SET NEXT). Then at step 261, if the re- 65 Following a successful allocation of a cache 40 ad- 

maining block count is not greater than one, the ICWs dressable data storage area at step 284, processor 31P at 

24 are transmitted to DAC 56 via LKP 25 in step 257. step 286 accesses the LDCB 62 for the addressed logical 

For a number of blocks remaining greater than one, device, section CMD 93, to determine whether the 
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cache miss resulted from a READ channel command or or aperiodic basis to ensure that FBL 79 will have an 
a WRITE channel command. For a WRITE channel entry for satisfying allocation requirements resulting 
command, a DEVICE END is forwarded to host II at from a cache miss. In such an instance when FBL 79 is 
step 287. That is, for handling a cache miss for a write not empty, then for a write command having a cache 
command all that is required is that data storage space 5 miss, the allocation step 284 can be rapidly performed 
be allocated within cache 40 to receive the data ex- for avoiding sending a channel command retry to host 
pected from host 11. When processor 3 LP is sufficiently 11 as indicated earlier in the present description. Avoid- 
fast, a CCR for a write command miss may be dispensed ing sending a channel command retry is a preferred 
with. In such an instance steps 284 and 286 functions mode of operating data storage system 10. 
precede step 280; then step 280 is performed only for a 10 The casting out data operation in accordance with 
read cache miss search as described for step 291. For a the invention not only identifies data to be moved from 
read operation indicated at step 286, processor 31P at cache 40 to a device 16, but also groups a plurality of 
step 291 sets the read queue (FIG. 3) for the associated data blocks from diverse cache 40 addressable storage 
device 16. For example, for device D2, a cache miss for areas to be sent to a single device 16 as a group of such 
LDCB 2 associated with device D2 results in the illus- 15 data blocks. When device 16 is a DASD having a plu- 
trated entry being made in read queue 128. Following rality of cylinders of tracks accessible by a plurality of 
setting the read queue, processor 31P proceeds to other transducers through electronic switching, then all of the 
operations at step 292. These other operations include data blocks storable in a cylinder of tracks along with a 
executing dispatcher 190 which searches for work to be first-identified data block are grouped for recording 
done within data storage system 10. As a pan of execut- 20 during a single device 16 selection. Under certain cir- 
ing dispatcher 190, the read queues 128 are scanned for cu instances, the number of data blocks may be limited 
identifying read operations scheduled to be performed. to a number less than the total number of blocks in a 
When read queue 128 for D2 is scanned, then at step given cylinder of tracks. For example, when there are 
293, processor 3 IP transfers the requested data blocks but eight SSARs 58, then a maximum of eight data 
from a device 16 (DASD), such as device D2, to cache 25 blocks can be transferred. For a cache 40 operating 
40. This, of course, involves processor 31P supplying sufficiently fast to handle all transfers independent of 
the read queue 128 information to LKP 25 to be used by immediate availability of cache addresses, then the max- 
DAC 56P. Once DAC 56P receives the necessary infor- imum number of data blocks in a group of data blocks to 
mation from the ICW chain, the data is transferred from be transferred is equal to the number of blocks in a 
the addressed device 16 to cache 40 using known 30 cylinder Where the data blocks are a subset of a track 
DASD read techniques. Upon completion of that read (each data block stores one-fourth of a track, for exam- 
operation, processor 31P at step 294 examines the ap- pie), then with eight SSAR*s eight blocks are transfer- 
propriate LDCB 62 for the second logical device of red— the equivalent data storage for two of the tracks 
device D2 sections CCR 95 and MISS 96 of foundation within a given cylinder. Other permutations on the 
portion 80. As a result of that examination, processor 35 grouping requirements may be added within the scope 
31 P realizes that the read promotion from the addressed and sphere of the present invention. Such grouping and 
device 16 to cache 40 resulted from a cache miss requir- writing occurs as a function of dispatcher 190 opera- 
ing a DEVICE END (DE) to be forwarded to host 11, tions as described with respect to FIG. 10. 
as indicated at step 294. The above-described scanning and grouping takes 

The reexecution of the channel command which 40 substantial time of processor 31P operation. Accord- 
caused the cache miss will occur at some later time. ingly, when there are no free blocks at step 281 of FIG. 
That is, host 11 responds to the DEVICE END sent at 9, rather than going firstly to the casting out operation, 
step 287 or 294 by resubmitting the channel command. processor 31P examines LRU list 46 for identification of 
In the meantime, at step 288 data storage system 10 data blocks stored in cache 40 which are not modified, 
receives unrelated commands to perform all kinds of 45 In a preferred form the LRU 46 entries having M=0 
data storage operations as may be requested by host 11 constitute a list of blocks available for allocation, i.e., 
and which are not related to the instant data transfer, as "free." That is, as shown in ADEB 76 of FIG. 3, M bit 
well as other asynchronous operations beyond the 124 is zero for the LRU 46 entry. As shown in FIG. 1, 
scope of the present description. Finally, at step 290 the M bits 47 are examined. Then the first-encountered 
host 11 supplies the command a second time such that 50 entry in LRU 46 below threshold AT 49 having an M 
data storage system 10, in searching directory 43, will bit of zero is allocated for receiving the data either from 
now have a cache hit occurring at step 163 of FIG. 6 host 11 or the addressed device 16. Such scan begins at 
resulting in the data being transferred from cache 40 to the LRU end (LRU+0) of the LRU list 46. The LRU 
host 11. Upon completing the resubmitted command, list 46 scanning is controlled by so-called J counter 37 of 
data storage system 10 proceeds to other data opera- 55 control store 73 (FIG. 2). The counter is initialized at 
tions such as via dispatcher 190. step 301 (FIG. 9) by setting it to all zeroes. With J equal 

In the event that FBL 79 identifies no blocks of cache to zero, the processor 31P in scanning LRU list 46 ac- 
40 as being free or a scan of LRU 46 to AT 49 finds no cesses the entry identifying the least recently used data 
entries with M bit 47 equal to zero, then some of cache block in cache 40. After initializing step 301, loop 300 
40 addressable storage areas have to be freed to permit 60 controls the scan of LRU list 46. First at step 302 the Jth 
allocation step 284 to be executed. Such freeing of ad- LRU 46 entry is read into processor 31 P. This means 
dressable storage areas of cache 40 occurs not only as a the directory 43 entry identified in the LRU 46 list 
result of a cache miss, but also by dispatcher 190 opera- through the index field 107 is read from system storage 
tions in scanning for work. For example, in accordance 30 into ADEB 76. At step 303, the just-read directory 
with predetermined priorities, beyond the scope of the 65 43 entry is examined for determining whether the M bit 
present description, dispatcher 190 may cause processor 124 is zero. If the M bit is zero, it is unmodified data, i.e., 
31P to follow logic path 299 to execute the following- the data stored in cache 40 is identical to the corre- 
described machine operations in loop 300 on a periodic sponding data stored in the identified device 16. Then at 
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step 304 the cache 40 addressable storage area just iden- 
tified is freed for allocation by deleting the identified 
directory 43 entry, as well as the contents of ADEB 76. 
Then, scan 300 is terminated and path 282 is followed to 
the previously described allocate step 284. If M does not 5 
equal zero, the data in cache 40 identified by the index 
of LRU J is modified then processor 31 P proceeds 
through loop 300 to index to the next least recently used 
entry of LRU list 46. At step 305 unity is added to the 
count J in register 37. At step 306 processor 31P com- 10 
pares the new J value with the value N + 1 which is the 
LRU 46 entry corresponding to the entry just above 
availability threshold AT 49 of FIG. 1. Please note that 
MRU— M has the same value as LRU+(N+1). When 
J is less than N + 1, processor 31P returns to step 302 to 15 
repeat the loop 300 until either the branch at step 303 
results in an unmodified data being identified or the 
availability threshold AT 49 has been reached. Then at 
step 307 processor 31P performs some unrelated func- 
tions before returning to dispatcher 190. When dis- 20 
patcher 190 is returned to from step 306, no space has 
been allocated within cache 40 for the data to be stored 
in cache 40 as a result of the cache miss, i.e., either read 
or write. The hoped for data transfer must now wait 
until data within cache 40 is destaged to a device 16, 25 
which, of course, will create some unmodified blocks 
resulting in allocation at 284. 

When no unmodified data blocks are in cache 40 after 
a cache miss or during periodic dispatcher 190 initiated 
scanning, the operation of data storage system 10 in- 30 
eludes scanning LRU list 46 in accordance with the 
invention and as shown in FIG. 10. The above-men- 
tioned scanning for establishing free blocks to make 
space available in cache 40 for data to be recorded or 
read occurs in two major steps. The fust step is to check 35 
the discard list DL 38 to see if any data can be dis- 
carded. Following that step, LRU list 46 (FIGS. 1 and 
4) is scanned from the least recently used entry up to 
availability threshold AT 49. Any hit (modified data) in 
this scan results in a second scan beginning at the hit and 40 
continuing through group threshold GT 57 for estab- 
lishing a group of data blocks to be recorded on a given 
device 16, the device for storing the modified cache 40 
data identified by the hit. 

When the free list is included as a part of LRU 46, 45 
examination after a cache miss omits step 281 and pro- 
ceeds directly to loop 300 through step 301. Of course, 
logic entry at step 299 may still occur for diverse rea- 
sons. 

Referring to FIG. 10 r from dispatcher 190, processor 50 
31P follows logic path 310 in the dispatcher's 190 look 
for work to be done. At step 311 DL 38 (FIG. 2) is 
examined for entries. If there are any entries in DL 38, 
at step 312 those entries are fetched for identifying 
which directory 43 entry is to be deleted at step 313 and 55 
for transferring the index value (index 107 of ADEB 76 
FIG. 3) to FBL 79. These actions create free blocks for 
cache 40. Processor 31P then can continue to loops 316 
and 330 for the LRU 46 scan or can perform step 314, 
which examines LDCB 62 for any logical device that 60 
has a CCR 95 and a MISS bit 96 set to unity. If such is 
the case, then processor 31P goes through page exit 319 
labeled "C" to allocate step 284 of FIG. 9. Then steps 
284 through 294 complete the data storage system's 10 
action with respect to the CCR identified in the LDCB. 65 
At this time processor 31P will not clear CCR 95 since 
it checks the next received command to determine 
whether or not that command was sent as a result of a 
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channel command retry. If at step 311 there is no entry 
in DL 38 or at step 314 if there is no LDCB having a 
CCR, then processor 31P proceeds to scan LRU con- 
trol list 46. At step 315 the scan is initialized by setting 
the J count in J register 37 to zero. Then loop 316 is 
entered for scanning from the least recently used index 
of LRU 46 to threshold AT 49. Loop 316 comprises 
reading the directory 43 entry identified by the index 
value stored in LRU J. J equals zero on the first pass 
through loop 316, hence, processor 31P reads LRU or 
the least recently used index to examine M bit 124 at 
step 318. When that M bit is zero, the J count is indexed 
by unity at 320. Then at step 321, the value of J is com- 
pared to N+ 1 (the entry in LRU 46 immediately above 
AT 49). When J is not yet equal to N+ 1, loop 316 is 
repeated. Upon completing loop 316, logic path 337 is 
followed returning processor 31P to dispatcher 190. In 
this instance, all blocks of data identified between 
LRU +0 and AT 49 have no modified data. That is, the 
machine operations shown in FIG. 10 either have been 
performed a sufficient number of times or other algo- 
rithms have caused movement of all of the modified 
data from cache 40 represented by the entries below AT 
49 to the devices 16. In this case, there is no need to 
move any data from cache 40 as any new allocation will 
find unmodified data blocks at step 303 of FIG. 9. 

In FIG. 10, when M bit 124 of the directory 43 entry 
being examined or the M value 47 in LRU 46 (FIG. 1) 
is unity, then a write hit on the scan has occurred. Pro- 
cessor 31P then follows logic path 325 to transfer the 
index value of LRU J to the write queue WQ 127 for the 
device identified in the currently examined entry, 
which is in ADEB 76, i.e., the device identified in the D 
bit of section 108. For example, if D2 is identified in D 
section 108 of ADEB 76, then the corresponding write 
queue 127 receives the index value from section 107 
(ADEB 76). At this time the flags 127F corresponding 
to device D2 are incremented by one. If the write queue 
had been empty, then the flag value would have a value 
of one; otherwise, the value will reflect a greater num- 
ber of entries in the write queue. This index value repre- 
sents a first-identified data block within cache 40 which 
is to be moved from cache 40 to a device 16. A hit 
terminates loop 316 and causes processor 31P to execute 
loop 330. 

Processor 31P in loop 330 scans LRU control list 46 
from the hit position, which for example can be 
LRU+1 (FIG. 1), through GT 57 or until an appropri- 
ate number of data blocks have been identified which 
are groupablc with the first-identified data block- When 
devices 16 are DASDs, then groupable data blocks in 
cache 40 are those data blocks having a CCP value in 
section 108 of the corresponding directory 43 entry 
equal to the CCP value of the first-identified data block; 
of course, within the same addressed device. 

The secondary scan to the secondary threshold GT 
57 only occurs when a hit occurred in loop 316. It be- 
gins at step 331 by processor 31P incrementing the J 
count by unity. In the FIG. 1 illustration, the next LRU 
entry to be examined corresponds to LRU+2. Accord- 
ingly, that directory 43 entry moves to ADEB 76. Then 
processor 31P at step 332 examines its M bit 124. Since 
its value is equal to zero, processor 31P follows logic 
path 333 back to step 331 for repeating loop 330. If the 
M value 124 is nonzero, then at step 334 processor 31P 
examines the CCP value of ADEB 76 and the CCP 
value of the first-identified data block which is in write 
queue WQ 127. In an alternative arrangement, a work 
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register (not shown) residing within processor 31P can busy at step 350, then at step 352 an ICW 24 chain is 
contain the device address represented in section 108 of built using the above-described procedures. At step 353, 
ADEB 76 (FIG. 3) such that comparison of the CCP the constructed ICW 24 chain is transferred to LKP 25 
values of the current ADEB 76 entry and the first-iden- to DAC 56 for execution. Then at step 354, the actual 
tifled data block is facilitated. Please note that the CCP S data transfers from cache 40 to the addressed device 16 
value represents the physical cylinder address on the occur. At step 355 some posttransfer operations, not 
device 16. In this manner, any virtual disk arrangements pertinent to an understanding of the present invention, 
within a device 16 will not alter nor affect scanning arc performed. At step 356, the corresponding M bit (47 
LRU control list 46. of LRU 46 (FIG. 1)) is reset and the entry kept in the 
If the cylinder addresses* CCP are different, then 10 text and FBL 79 receives the index values of the cache 
logic path 333 is followed to reinstitute a next scan of 40 addressable data storage areas which had contained 
loop 330. When both data blocks are in the same cylirt- the data blocks just transferred to the addressed device 
der, processor 31P at step 335 transfers the index value 16. This prepares the data storage system 10 to allocate 
of the LRU J-h I entry to write queue WQ 127 and space in cache 40 in accordance with the FBL 79 list At 
increments the flag 127F count. Then at step 336, pro- 15 step 357, LDCB 62 is examined to see if any CCR 95 
cessor 31 P examines the write queue WQ 127 to see if and MISS 96 bits are set to unity, i.e., a cache miss. If 
there are eight entries for the cylinder CCP. If there are there was a cache miss, then at step 358 FBL 79 is read 
eight entries, then a complete group of data blocks has to obtain the index value of one of the just-freed ad- 
been identified for transferring from cache 40 to a de- dressable storage areas of cache 40. At step 359, FBL 79 
vice 16 irrespective of the incompleteness of the scan in 20 is examined to see if it is empty. If it is empty, an error 
loop 330. Accordingly, dispatcher 190 then is returned has occurred, i.e. the step 358 was not successfully per- 
to such that the write queue scans, described later with formed. Then processor 31 P follows path 360 to an 
respect to FIG. 11, schedule the demotion of grouped error recovery procedure beyond the scope of the pres- 
data. If the grouping has not reached an upper limit, ent description. Otherwise, processor 31P proceeds to 
then at step 338, processor 31 P examines the J value in 25 allocation step 284 of FIG. 9 as indicated via off page 
register 37 to compare it with the constant MRU-K, i.e., connectors 361 of FIG. 11 and 283 of FIG. 9. If the 
the LRU control list 46 entry immediately above GT write queue scanning did not occur because of a cache 
57. Equality signifies completion of the secondary scan miss as indicated at step 357 by the CCR and MISS bits 
such that path 337 is followed to dispatcher 190. At this of LDCB not being unity, then at step 362 processor 
time there may be only one data block to be demoted or 30 31P performs some nonpertinent functions and returns 
there may be up to seven data blocks in the illustrated to dispatcher 190. Alternatively, from step 362, proces- 
embodiment When the value J has not yet reached sor 31P may return to loop 342 to complete scanning of 
MRU— K, then path 333 is followed to reinstitute one the write queues 127. However, under certain design 
more iteration of loop 330. constraints, it can be more appropriate for processor 
FIG. 11 illustrates the machine operations performed 35 31P to employ dispatcher 190 to scan for diverse types 
via processor 31P which scan all of the write queues 127 of work to be done rather than completing all writing to 
in looking for data stored in cache 40 to be transferred devices 16 that may appear in the write queues. Other 
to any one of the devices 16. Machine operations are design constraints may indicate immediate return to 
instituted from dispatcher 190 over logic path 340. At path 351 for reinstituting an iteration of loop 342. 
step 341 the contents of write queue counter WQK 84 40 FIG. 12 shows the processor 31 P implemented ma- 
are examined to determine which write queue 127 is to chine operation for a mode-setting command such as a 
be examined. WQK 84 can be treated as a shift register SET PAGING PARAMETERS (SPP) command 
having a number of digit positions equal to the number shown in CCW 19 of FIG. 1. The command is received 
of devices 16. A single bit is set to unity, with the bit through a channel adaptor 32. The command is de- 
position indicating which write queue is to be examined. 45 coded at step 365 by ACE 50 (FIG. 1). At step 366, 
Upon completion of examination of that write queue the processor 31P determines whether or not it is a mode- 
single one is shifted to the next digit position, enabling setting command, i.e., SPP of CCW 19. If the command 
the next write queue to be examined. In this manner a is not SPP, logic path 367 is followed by processor 31P 
round-robin queue examination is performed. to execute a different type of received command. For a 
Loop 342 examines the write queue flag 127F to 50 mode-setting command, at step 368 processor 31P ac- 
determine whether the associated write queue is empty cesses the appropriate LDCB associated with DADDR 
(127F equals zero) or is nonzero for indicating one or 20 of CCW 19 for setting the read and discard bit RD 
more entries. At step 343, the queue flags 127F corre- 101 of PPARMS 81 (FIG. 3) to the value in byte 22 as 
sponding to the value of WQK 84 are fetched from well as SEQ bits 94 and 100 of foundation 80 and 
control store 73. The queue flags are examined at step 55 PPARMS 81. Insofar as practicing the present inven- 
344. If the queue flags are 2ero, then loop 342 is com- tion is concerned, updating LDCB 62 for the addressed 
pleted by incrementing (shifting) WQK 84 by one at logical device completes the execution of the mode 
step 345. At step 346, the shifted value is compared with setting command. Other SET PAGING PARAME- 
the initial value fetched at step 341. If the values are TERS commands may include other control parame- 
equal, a scan has been completed. Then processor 31P 60 ters which will have to be updated in the control data 
follows path 347 returning to dispatcher 190. Other- structure of data storage system 10, preferably within 
wise, steps 343-345 are repeated. Whenever write control store 73. At step 369, processor 31P supplies 
queue flags 127 are nonzero, then processor 31 P follows ending status to host 11 in the usual manner. Other 
path 348 to examine at step 350 whether or not the functions may be performed at 370 before processor 
identified device is busy. If the device is busy, then no 65 31 P returns to dispatcher 190 in looking for additional 
work is scheduled for that device and processor 31P work. 

follows logic path 351, returning to step 346 for con- While the invention has been particularly shown and 

tinuing scanning through loop 342. If the device is not described with reference to preferred embodiments 
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thereof, it will be understood by those skilled in the art 
that various changes in form and details may be made 
therein without departing from the spirit and scope of 
the invention. 

What is claimed is: 5 

1. In a peripheral data storage system having host 
connection means for connecting the data storage sys- 
tem to a host processor and having a cache and a back- 
ing store, means for transferring data signals between 
said cache store and said backing store, said cache and 10 
backing store each having a plurality of addressable 
data storage areas for storing data, directory means 
connected to the cache store for enabling the addressing 
of the cache store areas using backing store addresses; 

the improvement comprising: 15 
first means for maintaining a control list having an 
entry for each allocated one of said addressable 
data storage areas in said cache storing data allo- 
cated from said backing store, each said entry in- 
cluding a first indicator indicating that data stored 20 
in said area associated with said entry has been 
modified from the corresponding data stored in 
said backing store, and a second indicator, indicat- 
ing a relationship of data stored in said area associ- 
ated with said entry to other data stored in said 25 
cache; 

first scan means coupled to said first means for scan- 
ning a first portion of said control list to identify a 
first one of said addressable data storage areas in 
said cache store storing modified data; 30 

second scan means coupled to said first means and to 
said first scan means for scanning said control list 
from said first one of said addressable data storage 
areas in said first portion of said control list 
through a second portion of said control list to 35 
identify further ones of said addressable data stor- 
age areas in said cache having a predetermined 
relationship to data stored in said first one of said 
addressable data storage areas; and 

means coupled to said means for transferring data 40 
signals between said cache and said backing store 
and to said first and second scan means to link 
addressable data storage areas in cache identified as 
having said predetermined relationship as data to 
be transferred as a group of data blocks from said 45 
cache to said backing store. 

2. The system according to claim 1 wherein said 
backing store includes a plurality of data-storage areas 
each constituting a cylinder of addressable data-storage 
registers, and further including means limiting said sec- 50 
ond scan means to identifying only said allocated cache- 
store addressable data-storage areas that are associable 
within the cylinder containing said first-identified one 
addressable data storage area. 

3. The system according to claim 2, further including: 55 
said second scan means further having means for 

receiving peripheral commands from said host 
connection means for addressing said backing store 
addressable data-storage registers; said peripheral 
commands indicating an addressed register; and 60 
logical device means coupled to said transferring 
means for storing said peripheral commands and 
for identifying a cylinder of said backing store 
containing said addressed registers. 

4. The system according to claim 1, further including: 65 
second list means for identifying addressable data- 
storage areas in said cache store that are storing 
data discarded from the cache store and to be cou- 
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pled to said means for linking, third scan means for 
scanning said second list means prior to said first 
and second scan means scanning said first list 
means such that said cache-store addressable data- 
storage areas identified in said second list means are 
available for allocation prior to the cache-store 
addressable data-storage areas of said cache store 
that arc identified in said first means; and said 
means for linking including means for freeing said 
cache-store addressable data-storage areas for allo- 
cation without transferring any data from said 
cache store to said backing store. 

5. The peripheral data storage system set forth in 
claim 1 or 4, further including: 

cache control means coupled to said cache store and 
to said host connection means for receiving re- 
quests for data access from a connected host pro- 
cessor via said host connection means, the cache 
control means including a directory means, said 
control list means and a directory inquiring means 
connected to said directory means for determining 
if a given received request for data access relates to 
an allocated addressable data-storage area in said 
cache store for evaluating a cache hit for enabling 
access to said cache store for completing a data 
access requested by said received data-access re- 
quest and when received request for data access 
does not relate to allocated addressable data-stor- 
age area in the cache store for indicating a cache 
miss; 

means coupled to said host connection means and to 
said cache control means for reporting said indi- 
cated cache miss to said host connection means as 
a request to retry said received request for data 
access and having logical-device means indicating 
said indicated cache miss and logical association 
with said received request for data access and in- 
cluding means for initiating scanning said first list 
means for identifying a one of said addressable 
data-storage areas in said cache store as being avail- 
able for allocation; and 

means in said cache control means responsive to said 
indicated cache miss in said logical-device means 
into a free indicated one of said addressable data- 
storage areas in said cache store to allocate said 
free addressable data-storage area to said received 
data request and signalling said host connection 
means that said given received data access request 
can be retried. 

6. The machine-implemented method of managing 
data storage space allocations for a cache having a plu- 
rality of data storage spaces attached to a host and to a 
backing store having a plurality of addressable data 
storage elements, a directory of said data storage spaces 
for indicating said space allocations with respect to 
addresses of said data storage elements and whether or 
not such allocated data storage spaces respectably are 
storing data which is modified from data stored in re- 
lated ones of said data storage elements, control list 
means for indicating and listing accesses to said data 
storage elements in an order of priority for replacement 
of data stored in said cache data storage spaces in accor- 
dance to predetermined usage characteristics of said 
stored data; 

comprising the steps of: 

establishing a first threshold in said control list means 
representing a first predetermined number of data 
storage space allocations listed in said control list 
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means for replacement from a data storage space 
indicated in said control list means as the data stor- 
age space containing data most likely to be re- 
placed; 

establishing a second threshold in said control list 
means representing a second predetermined num- 
ber of indicated data storage space allocations 
listed in said control list means, said second prede- 
termined number being larger than said first prede- 
termined number; 

scanning said control list means beginning at said 
given most tikely to be replaced indicated data 
storage space and proceeding towards that estab- 
lished first threshold; 

identifying during said scan a data storage space stor- 
ing modified data; said modified data having prede- 
termined data storage characteristics; 

listing data storage spaces identified as storing modi- 
fied data with a first encountered one of said indi- 
cated data storage spaces during said scan of data 
storage space, storing modified data defined as a 
first identified one of said data storage spaces; 

continuing said scan from said first identified one of 
said spaces storing nodified data to said second 
threshold for further identifying additional ones of 
said data storage spaces storing nodified data hav- 
ing said predetermined data storage characteristics; 

adding said additional ones of said indicated data 
storage spaces to said list; and 

transferring data stored in said data storage spaces in 
said list from said cache to said backing store as a 
serial stream of data. 

7. The machine implemented method set forth in 
claim 6, further including the steps of: 

maintaining a second list in said control list means of 
data storage spaces storing data which meets pre- 
determined criteria for removal from said cache; 
and 

adjusting said control list means by deleting identifi- 40 
cation of said data-storage spaces storing data to be 
discarded from said control list means before scan- 
ning said control list means. 

8. The machine-implemented method set forth in 
claim 6 or 7, further including maintaining a free list of 45 
free data-storage spaces which are immediately avail- 
able for allocation to receive data; and 

examining said free list and initiating freeing ones of 
said data-storage spaces when the number of 
entries in said free list are less than a given number. 

9. The machine-implemented method set forth in 
claim 6 or 7, further including the machine-executable 
steps of: 

receiving from said host a request for a data access; 

examining said directory to determine if a data-stor- 
age space allocation is made in said cache that 
relates to said received request for data access, if 
said directory indicates a space is allocated then 
performing the data access, otherwise initiating a 
request for allocation of a data-storage space allo- 
cation; and 

establishing a free list of said spaces indicating which 
of said spaces are immediately available for alloca- 
tion in response to said request for allocation, then 



10. A peripheral data-storage system having a plural- 
ity of addressable direct-access data-storage devices 
(DASD), each of said DASDs having a plurality of 
addressable cylinders wherein each cylinder has a pi u- 
5 rality of addressable data-storing memory segments, 
high-speed buffer store having a plurality of buffer 
segments, each said buffer segment having a data-stor- 
ing capacity equal to the data-storing capacity of said 
memory segments, connection means for attaching the 
10 system to a host; 

the improvement including in combination: 
receiving means for receiving peripheral commands 
from host connection means for fetching data from 
said DASDs; 
a digital processor connected to said connection 
means and to said receiving means and having a 
control store for storing programs of instructions 
for operating the data-storage system; 
signal means connected to said connection means, 
digital processor, said DASDs and said buffer for 
transferring signals between said DASDs, said 
buffer and said host connection means; 
first program means in said control store for enabling 
said processor to operate the storage system to 
transfer one segment of data from said DASDs to 
said high-speed buffer store in response to a one of 
said received peripheral commands; 
second program means in said control store for en- 
abling said processor via said first program means 
to maintain a control list of said buffer segments in 
an order reflecting host connection means accesses 
to data stored in the respective buffer segments and 
to maintain a list of said buffer segments free for 
allocation for data storage; and 
third program means in said control store for en- 
abling said processor to first scan said control list 
for data stored in one of said buffer segments to be 
transferred from said buffer store to one of said 
DASDs and secondly to scan said control list for 
additional data stored in said buffer store having a 
predetermined DASD address relationship to said 
one buffer segment DASD address for grouping 
said one buffer segment DASD address and addi- 
tional data for transfer to one of said DASDs under 
control of said first program means and including 
means to activate said first program means upon 
completion of said second scan wherein said third 
program means is coupled to said second program 
means to transfer identification signals for said one 
and additional buffer store segments from said con- 
trol list to said free list. 

11. The peripheral storage system set forth in claim 
10 wherein each of said DASDs has a plurality of cylin- 
ders of record tracks, all record tracks in each cylinder 
having a given radial address, respectively, each of said 
memory segments being in respective ones of said re- 
cord tracks, further including: 

fourth program means in said control store for en- 
abling the processor to operate the storage system 
to limit said one buffer segment DASD address and 
additional data stored in said buffer store to that 
data storable in a given cylinder of one of said 
DASDs. 

12. A hierarchical data-storage system having con- 



15 



20 



25 



30 



35 



50 



55 



60 



first examining said free list and allocating any 65 nection means for connecting the data-storage system to 
data-storage space identified on said free list for a host processor, the system including a high-speed data 
said received request for data access, otherwise cache and a relatively slow-speed backing store, data- 
initiating freeing a one of said data-storage spaces. transfer paths coupled to said cache and backing store 
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for transferring data between addressable storage loca- 
tions in said date cache and said backing store, cache 
replacement control means coupled to said data-transfer 
paths and said cache for being responsive to the con- 
tents of the storage locations in said cache to select 5 
particular items of data for replacement in accordance 
with predetermined replacement criteria, and data- 
transfer control means coupled to said data-transfer 
paths and said backing store for identifying locations in 
said backing store to receive data items so selected; 10 
characterized in that: 

said data-transfer control means grouping said se- 
lected data items with that data accessaWe through 
one of said data-transfer paths and to activating 
such data-transfer paths on a group-by-group basis, 1 5 
each group consisting of data items whose transfer 
involves the one said data-transfer path. 

13. A system according to claim 12 wherein said 
backing store includes a plurality of cylinders each 
cylinder including one or more storage registers, 20 
wherein read or write access to registers in different 
ones of said cylinders is subject to access delays, each of 
said cylinders being in a different one of said data-trans- 
fer paths. 

14. A system as claimed in claim 12 in which said 25 
backing store comprises a plurality of addressable di- 
rect-access magnetic disk data-storage devices, each 
device having a plurality of addressable data-storing 
cylinders and each cylinder having a plurality of said 
addressable memory segments, said cache comprises a 30 
high-speed buffer store having a plurality of said buffer 
segments constituting said cache storage locations, each 
buffer segment having a data-storing capacity equal to 
the data-storing capacity of said memory segments, 
further characterized by a command register for receiv- 35 
ing peripheral commands from said host connection 
means to fetch data from said date-storage devices; a 
digital processor having a control store for storing pro- 
grams of instructions for operating the storage system; 
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first program means in said control store for enabling 
said digital processor to operate the storage system to 
transfer one segment of data from said backing store to 
said cache for each of said requests for a segment of data 
received from said host connection means; second pro- 
gram means activated via said first program means and 
stored in said control store for enabling said digital 
processor to maintain a control list of identifications of 
said bufFer segments in an order reflecting host connec- 
tion means accesses to data stored in the respective 
buffer segments and to maintain a list of identifications 
of said buffer segments free for allocation for receiving 
data for storage; third program means in said control 
store for enabling said processor to first scan said con- 
trol list for data stored in a one of said buffer store 
segments to be transferred from said buffer store to a 
one of said storage devices and secondly to scan said 
control list for additional date stored in said buffer store 
having an identification located in a predetermined 
position in said control list with respect to said one 
buffer store segment identification in the control list for 
grouping said one and additional data for transfer to one 
of said storage devices under control of said first pro- 
gram means and including means for enabling the pro- 
cessor to activate said first program means upon com- 
pletion of said second scan and coupled to said second 
program means to transfer said identifications for said 
one and additional buffer store segments from said con- 
trol list to said free list. 

15. A system as claimed in claim 14 wherein each of 
said data-storage devices has a plurality records tracks, 
all record tracks in each cylinder having a same radial 
address, further characterized by fourth program means 
in said control store for enabling the processor to oper- 
ate the storage system to limit data stored in said buffer 
store to that data storable in a given cylinder of one of 

said storage devices. 

• * * • * 
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